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Abstr act. This is an overview of the basic tools of nonsmooth analysis which 
are grounded on nonstandard models of set theory. By way of illustration we 
give a criterion for an infinitesimally optimal path of a general discrete dynamic 
system. 



Introduction 

Analysis is the technique of differentiation and integration. Differentiation dis- 
covers trends, and integration forecasts the future from trends. Analysis relates to 
the universe, reveals the glory of the Lord, and implies equality and smoothness. 

Optimization is the choice of what is most preferable. Nonsmooth analysis is the 
technique of optimization which speaks about the humankind, reflects the diversity 
of humans, and involves inequality and obstruction. The list of the main techniques 
of nonsmooth analysis contains subdifferential calculus (cp. [TJ|5]). 

A model within set theory is nonstandard if the membership between the objects 
of the model differs from that of the originals. In fact the nonstandard tools of 
today use a couple of set-theoretic models simultaneously. The most popular are 
infinitesimal analysis (cp. [HE]) and Boolean-valued analysis (cp. 0[6]). 

Infinitesimal analysis provides us with a novel understanding for the method 
of indivisibles or monadology, synthesizing the two approaches to calculus which 
belong to the inventors. 

Boolean valued analysis originated with the famous works by Paul Cohen on the 
continuum hypothesis and distinguishes itself by the technique of ascending and 
descending, cyclic envelopes and mixings, and -B-sets. 

Calculus reduces forecast to numbers, which is scalarization in modern parlance. 
Spontaneous solutions are often labile and rarely optimal. Thus, nonsmooth analy- 
sis deals with inequality, scalarization and stability. Some aspects of the latter are 
revealed by the tools of nonstandard models to be discussed. 



Environment for Optimization 
The best is divine — Leibniz wrote to Samuel ClarkeQ 
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God can produce everything that is possible or whatever does not imply a con- 
tradiction, but he wills only to produce what is the best among things possible. 

Choosing the best, we use preferences. To optimize, we use infima and suprema 
for bounded sets which is practically the least upper bound property. So optimization 
needs ordered sets and primarily boundedly complete lattices. 

To operate with preferences, we use group structure. To aggregate and scale, we 
use linear structure. 

All these are happily provided by the reals R, a one-dimensional Dedekind com- 
plete vector lattice. A Dedekind complete vector lattice is a Kantorovich space. 

Since each number is a measure of quantity, the idea of reducing to numbers is 
of a universal importance to mathematics. Model theory provides justification of 
the Kantorovich heuristic principle that the members of his spaces are numbers as 
well (cp. [3] and [TO]). 

Life is inconceivable without numerous conflicting ends and interests to be har- 
monized. Thus the instances appear of multiple criteria decision making. It is 
impossible as a rule to distinguish some particular scalar target and ignore the rest 
of them. This leads to vector optimization problems, involving order compatible 
with linearity. 

Linear inequality implies linearity and order. When combined, the two produce 
an ordered vector space. Each linear inequality in the simplest environment of the 
sort is some half-space. Simultaneity implies many instances and so leads to the 
intersections of half-spaces. These yield polyhedra as well as arbitrary convex sets, 
identifying the theory of linear inequalities with convexity. [IT] 

Assume that X is a vector space, E is an ordered vector space, / : X — > E* is 
some operator, and C := dom(/) C X is a convex set. A vector program (C, /) is 
written as follows: 

x £ C, f(x) -> inf. 

The standard sociological trick includes (C, /) into a parametric family yielding 
the Legendre trasform or Young-Fenchel transform of /: 

f*(l) := sup (l(x) - f(x)), 
xex 

with 1 e I* a linear functional over X. The epigraph of /* is a convex subset of 
X# and so /* is convex. Observe that — /*(0) is the value of (C, /). 

A convex function is locally a positively homogeneous convex function, a sublin- 
ear functional. Recall that p : X — s- R is sublinear whenever 

epip := {(x, t) e X x R | p(x) < t} 

is a cone. Recall that a numeric function is uniquely determined from its epigraph. 
Given C C X, put 

H{C) := {{x, t) G X x R+ | x 6 tC}, 

the Hormander transform of C . Now, C is convex if and only if H(C) is a cone. 
A space with a cone is a (pre) ordered vector space. 

Thus, convexity and order are intrinsic to nonsmooth analysis. 

Boolean Tools in Action 

Assume that A is a real vector space, Y is a Kantorovich space. Let B := M(Y) 
be the base of Y, i.e., the complete Boolean algebras of positive projections in Y; 
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and let m(Y) be the universal completion of Y. Denote by L(X,Y) the space 
of linear operators from X to Y . In case X is furnished with some Y-seminorm 
on X, by L^ m ^{X, Y) we mean the space of dominated operators from X to Y . As 
usual, {T < 0} := {x £ X | Tx < 0}; ker(T) = T -1 (0) for T : X Y. Also, 
P £ Sub(A, Y) means that P is sublinear, while P £ PSub(A, Y) means that P is 
polyhedral, i.e., finitely generated. The superscript ( m ) suggests domination. 
Kantorovich's Theorem^ Consider the problem of finding X satisfying 

X — ^-5- W 

y 

(1) : (3X) 3L4 = B O ker(A) C ker(B). 

(2) : If is ordered by W+ and A(X) -W+ = W + - A{X) = W, then 

(3X > 0) XA = B o {A < 0} c {B < 0}. 

The Farkas Alternative]! I<et A be a Y -seminormed real vector space, with 
Y a Kantorovich space. Assume that A\ , . . . , An and B belong to L( m ) (A, Y) . 
Then one and only one of the following holds: 

(1) There are x € A and b, b' e B such that b' < b and 

b'Bx > 0, bAix < 0, . . . , bA N x < 0. 

(2) There are positive orthomorphisms cti,...,a>N & Orth(m(y)) + such that 

Theorem lJJ Let X be a Y -seminormed real vector space, with Y a Kantorovich 
space. Assume given some dominated operators A\, . . . , An, B <E L^ m \X, Y) and 
elements u\, . . . , un, v € Y. The following are equivalent: 

(1) For all b £ B the inhomogeneous operator inequality bBx < bv is a conse- 
quence of the consistent simultaneous inhomogeneous operator inequalities bA-^x < 
bu\, . . . , bANX < buN, i.e., 

{bB < bv} D {bAi < but] n • • • n {bA N < bu N }- 

(2) There are positive orthomorphisms ct-y, . . . , € Orth(m(y)) satisfying 

N N 

B = '^a k A k ; v > a k u k . 

k=l fe=l 

Infinitesimal Tools in Action 

Leibniz wrote about his version of calculus that "the difference from Archimedes 
style is only in expressions which in our method are more straightforward and more 
applicable to the art of invention." 

Nonstandard analysis has the two main advantages: it "kills quantifiers" and it 
produces the new notions that are impossible within a single model of set theory. 



2 C P . p. 51]. 
3 C P . p2l Th. 1]. 
4 Cp. 13, Th. 1]. 
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By way of example let us turn to the nonstandard presentations of Kuratowski- 
Painlcve limits and the concept of infinitesimal optimality. 

Recall that the central concept of Leibniz was that of a monadic In nonstandard 
analysis the monad n(^) of a standard filter & is the intersection of all standard 
elements of & " . 

Let F C X x Y be an internal correspondence from a standard set X to a standard 
set Y. Assume given a standard filter jV on X and a topology r on Y. Put 



W(F) 
3V(F) 
V3(F) 
33(F) 



'{y 1 | (\fxe^)ndom(F))(\fy^y , )(x,y)EF}, 
'{y 1 | (3x e fi(,J^) ndom(F))(y y ^ y')(x,y) E F}, 
■y | (Vxe^)ndom(F))(3ytty')(x,y) £ F}, 
'{y' | (3 x G M(^) n dom(F))(3 y « 2/) G 



with * symbolizing standardization and y ks y' standing for the infinite proxitity 
between y and y' in t, i.e. y' G ^t(r(y)). Call QiQ2(F) the QiQ2-femi of F (here 
Qk (fc := 1, 2) is one of the quantifiers V or 3). 

Assume for instance that F is a standard correspondence on some element of 
,yV and look at the 33-limit and the V3-limit. The former is the limit superior or 
upper limit; the latter is the limit inferior or lower limit of F along ,jV . 

Theorem 20 If F is a standard correspondence then 

33(F) = f) cl(|J F(a 

V3(F) = f| clf{J F(i 

where JV is the grill of a filter JV on X, i.e., the family comprising all subsets of 
X meeting [l(:jY). 

Convexity of harpedonaptae was stable in the sense that no variation of stakes 
within the surrounding rope can ever spoil the convexity of the tract to be surveyed. 

Stability is often tested by perturbation or introducing various epsilons in appro- 
priate places. One of the earliest excursions in this direction is connected with the 
classical Hyers-Ulam stability theorem for e-convex functions. Exact calculations 
with epsilons and sharp estimates are often bulky and slightly mysterious. 

Assume given a convex operator / : X — >■ E m and a point x in the effective 
domain dom(/) := {x G X f(x) < +00} of /. Given e > in the positive cone 
E+ of E, by the e- subdifferential of / at x we mean the set 

d e f(x) := {T G L(X, E) I (Vie X)(Tx- f(x) < Tx - f(x) + e)}. 

The usual subdifferential df(x) is the intersection: 

df(x) := f| 8J(x). 

s>0 

In topological setting we use continuous operators, replacing L(X, E) with Jif(X, E). 

Some cones K\ and K2 in a topological vector space X are in general position 
provided that 



5 c P . na. 

6 Cp. El Sect. 5.2]. 
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(1) the algebraic span of K\ and K 2 is some subspace Xo C X; i.e., Xo = 
K 1 -K 2 = K 2 -K 1 \ 

(2) the subspace Xo is complemented; i.e., there exists a continuous projection 
P : X -> X such that P(X) = X Q ; 

(3) K\ and K 2 constitute a nonoblate pair in Xq. 

Finally, observe that the two nonempty convex sets G\ and C 2 are in general 
position if so are their Hormander transforms H(C±) and H(C 2 ). 

Theorem 3^ Let f\ : X x Y — > E* and f 2 :YxZ^-E' be convex operators 
and S, e G E + . Suppose that the convolution f 2 A fi is 5-exact at some point 
(x, y, z); i.e., S + (f 2 A /i)(x, y) — /i(x, y) + f 2 (y, z). If, moreover, the convex sets 
epi(/i, Z) and epi(X, f 2 ) are in general position, then 

9 E (f 2 A fi)(x,y) = |J d £2 f 2 (y,z)od £l fi(x,y). 

£1>0,£2>0, 

ei+S2=£+S 

Some alternatives are suggested by actual infinities, which is illustrated with the 
conception of infinitesimal subdifferential and infinitesimal optimality. 

Distinguish some downward-filtered subset S of E that is composed of positive 
elements. Assuming E and § standard, define the monad of <§ as [i{§) := 

P|{[0,e] I e G °to}. The members of ^{S) are positive infinitesimals with respect 
to S . As usual, °S denotes the external set of all standard members of E, the 
standard part of $ . 

Assume that the monad n{&) is an external cone over °R and, moreover, /z(<^) fl 
°E = 0. In application, <S is usually the filter of order-units of E. The relation of 
infinite proximity or infinite closeness between the members of E is introduced as 
follows: 

ei w e 2 O ei - e 2 £ /x(<^) & e 2 - ei G 

Now 

Df(x) := f| 5 e /(5) = |J dj(x), 

which is the infinitesimal subdifferential of / at x. The elements of Df(x) are 
infinitesimal subqradients of / at x. 

Theorem 4[] Let f\ : X x Y — > E* and f 2 :Y x Z — > E* be convex operators. 
Suppose that the convolution f 2 A f\ is inhnitesimally exact at some point (x, y, z); 
i.e., (f 2 A fi)(x,y) w fi(x,y) + f 2 (y,z). If, moreover, the convex sets epi(/i,Z) 
and epi(A, f 2 ) are in general position then 

D(f 2 A h)(x,y) = Df 2 (y,z)oDf 1 (x,y). 

Assume that there exists a limited value e := inf^c f(x) of some program (C, /). 
A feasible point xo is called an infinitesimal solution if /(^o) « e, i.e., if f(xo) < 
/(x) + e for every x G C and every standard e E $. 

A point xo G X is an inhnitesimal solution of the unconstrained problem f(x) — > 
inf if and only if G Df(x ). 

Consider some Slater regular program 

Ax = Ax, g{x) < 0, /(x) — )• inf; 



7 Cp. Th. 4.2.8]. 
8 Cp. Th. 4.6.14]. 
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i.e., first, A 6 L(X, X) is a linear operator with values in some vector space X, 
the mappings / : X — > E* and g : X — > F* are convex operators (for the sake of 
convenience we assume that dom(/) = dom(g) = X); second, F is an Archimedean 
ordered vector space, E is a standard Kantorovich space of bounded elements; and, 
at last, the element g(x) with some feasible point a; is a strong order unit in F. 

Theorem 5.Q A feasible point xq is an infinitesimal solution of a Slater regular 
program if and only if the following system of conditions is compatible: 

peL+{F,E), 7 e 75(^0) « 0, 

Oefl/(x„) + fl(/?o S )(i„) + 7 °A. 

By way of illustration look at the general problem of optimizing discrete dynamic 
systems. 

Let Xq, . . . , Xn be some topological vector spaces, and let G k ■ Xk-i =4 X k be 
a nonempty convex correspondence for all k := 1, . . . , N. The collection G±, . . . , Gjv 
determines the dynamic family of processes {Gk,i) k< i <N , where the correspondence 
Gk,i '■ Xk =$ Xi is defined as 

G k ,i ■= G fc+ i o • • • o Gi if k + 1< I; 

G k , k+1 := G k+1 (fc:=0,l,...,JV-l). 

Clearly, G k ,i ° G; iTn = Gk, m for all fc < / < m < N. 

A path or trajectory of the above family of processes is defined to be an ordered 
collection of elements y := (xq, . . . ,xn) such that xi £ Gk,i(xk) for all k < I < N. 
Moreover, we say that xq is the beginning of y and xn is the ending of y. 

Let Z be a topological ordered vector space. Consider some convex operators f k ■ 
Xk — > Z (k := 0,...,N) and convex sets So C X and Sn C Ajv- Assume 
given a topological Kantorovich space E and a monotone sublinear operator P : 
Z N+1 — *-E m , Given a path y := (x , . . . ,xjy), put 

f(?) := (fo(xo),fi(xi).-.Jk(x N ))- 

Let Pr,t : Z N+1 — Z denote the projection of Z N+1 to the fcth coordinate. Then 
Pr fc (f(y)) = fk{x k ) for aU k := 0, . . . , N. 

Observe that f is a convex operator from X to Z which is the vector target of 
the discrete dynamic problem under study. Assume given a monotone sublinear 
operator P : Z N+1 to E*. A path y is feasible provided that the beginning of y 
belongs to So and the ending of y, to Sn- A path y° := (Xq, . . . , ir^) is infinitesimally 
optimal provided that x^ g Sq, x^ £ 5jy, and Poj 1 attains an infinitesimal minimum 
over the set of all feasible paths. This is an instance of a general discrete dynamic 
extremal problem which consists in finding a path of a dynamic family optimal in 
some sense. 



9 C P . [6] Sect. 5.7]. 
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Introduce the sets 

N N 

C :=S xl[X k ; C x := G x x ]J X k ; 



k=l k=2 
N N-2 

C 2 :=X xG 2 xl[x k ;...; C N := ]J X k x G N ; 

k=3 k=0 
JV-1 N 

Cn+i '■= W X k x Sn; X :— J^J X k . 

k=l k=0 

Theorem 6. Suppose that the convex sets 

Co x E+,...,C N+1 x E+ 

are in general position as well as the sets X x epi(P) and epi(f) x E. 

A feasible path [x^, . . . , x N ") is inhnitesimally optimal if and only if the following 
system of conditions is compatible: 

a k eJ?{X k ,E), h^^+{Z,E) (k :=(),..., N); 

/3ed{P); fa :=/3oPr fe ; 

(a fc _i, a k ) e DG k {xl_ lt xl) - {0} x D(fa o f k )(x° k ) (k := 1, . . . , N); 

-a e DS (x ) + D(fa o / )(a; ); a N € DS N {x N ). 

Proof. Each inhnitesimally optimal path u := (xq, . . . ,x^j is obviously an 
inhnitesimally optimal solution of the program 

v e C n • • • nCjy+i, P o f (v) ->• inf . 

By the Lagrange principle the optimal value of this program is the value of some 
program 

v e C n • • • n CW+i, fl(u)->inf, 

where g(w) := f3(f(v)) for all paths v with /3 S 9P. The latter has separated targets, 
which case is settled (cp. [6j p. 213]). 
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